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The MAILING DATE of this communication appears on the cover sheet with the correspondence address « 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)S Responsive to communication(s) filed on 13 November 2002 . 
2a)D This action is FINAL. 2b)^ This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
Disposition of Claims 

4) ^3 Claim(s) 1-30 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^3 Claim(s) 7-30 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

1 1) D The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

13) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 

a)D All b)D Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. Q Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) Q Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121 . 
Attachment(s) 

1) ^ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) Paper No(s). . 



2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) □ Notice of Informal Patent Application (PTO-152) 

3) □ Information Disclosure Statement(s) (PTO-1449) Paper No(s) . 6) □ Other: 
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DETAILED ACTION 



Claim Rejections - 35 USC § 102 



The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in a patent granted on an application for patent by another filed in the United 
States before the invention thereof by the applicant for patent, or on an international application by another who 
has fulfilled the requirements of paragraphs (1), (2), and (4) of section 371(c) of this title before the invention 
thereof by the applicant for patent. 



The changes made to 35 U.S.C. 102(e) by the American Inventors Protection Act of 1999 



was not (1) filed on or after November 29, 2000, or (2) voluntarily published under 35 U.S.C. 
122(b). Therefore, this application is examined under 35 U.S.C. 102(e) prior to the amendment 
by the AIPA (pre-AIPA 35 U.S.C. 102(e)). 

1. Claims 1, 14, and 23 are rejected under 35 U.S.C. 102(e) as being anticipated by Schein et al 
(US Patent No. 6,075,575). 

As per claims 1, 14, 23, Schein et al. disclose a system/method comprising: 

a speech recognizer that recognizes spoken requests for television programming 

information, (see col. 6, lines 12-16); i 

an output device that generates response to spoken requests fro television programming 

information, (see Fig. 4A). 



(AIPA) do not apply to the examination of this application as the application being examined 
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Claim Rejections - 35 USC § 103 



The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

2. Claims 2 , 12-13, 15, 22, 24 and 30 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Schein et al. in view of Tomitsuka et al, Patent No. 5,566,27 1. 

As per claims 2, 15, and 24, Schein et al. discloses everything as claimed in claims 1, 14, 
and 23. Schein et al. Fail to explicitly teach a system including a module coupled to said 
recognizer to implement conversational speech. However, this feature was well known in the art. 

In a similar field of endeavor, Tomitsuka disclose a system comprising a voice synthesis 
module for implementing conversational speech, (see Fig. 1, block 19). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use a voice synthesis module in Schein, as taught by Tomitsuka , for the 
purpose of using a voice synthesis in conjunction with a voice recognition module to improve 
man-machine interaction, as suggested by Tomitsuka. 

As per claim 12, Schein et al. discloses everything as claimed in claim 1. Schein et al. 
further disclose a system including a television coupled to a set top box and a remote control 
(see col. 3, lines 21-24). 

As per claims 13, 22, and 30, Schein et al. discloses everything as claimed claims 1,14 
and 23. Schein fail to explicitly teach a system wherein the output device is a speech synthesizer 
that generates responses. However, this feature was well known in the art. 
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Tomitsuka discloses a system wherein the output device is a speech synthesizer that 
generates responses(see Fig. 1, block 19). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use a voice synthesis module as taught by Tomitsuka in the system of 
Schein, for the purpose of improving man-machine interaction, as suggested by Tomitsuka. 

3. Claims 3, 16, and 25 are rejected under 35 U.S.C. 103(a) as being unpatentable over Schein 
in view of Tomitsuka as applied to claims 2, 15, and 24 above, and further in view of Mueller 
et al (US Patent No. 6,009,398). 

As per claims 3, 16, and 25, the combination of Schein and Tomitsuka teaches everything 
as claimed in claims 2, 15, and 24. Additionally, Schein discloses a graphical user interface 
which provides information in a visual form about television programming and a voice user 
interface which responds to voice requests from the user (see Fig. 4A and col. 6, lines 36-42). 

However, the combination does not specifically disclose the graphical user interface and 
voice user interface communicating such that the focus of one is communicated to the other. 
However this feature was well known. 

In a similar field of endeavor, Mueller discloses a system, which allows for user and 
system interaction via speech, visual and auditory interfaces. Specifically, at col. 4, line 56 
continuing to col. 5, line 29, Mueller teaches implementation of a context analyzer which 
coordinates the speech interactions with the visual interface to accommodate how the user 
interacts with system when the user provides input via speech or via a text based graphical user 
interface. 
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Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to implement interface focus communication as taught by Mueller, for the purpose of ensuring 
system performance when the user provides input via a visual or graphical user interface, as 
suggested by Mueller. 



4. Claims 4-8, 17-19, and 26-28 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Schein in view of Tomitsuka as applied to claims 2, 15, and 24 above, and further in view of 
Haddock (US Patent No. 5,265,014). 

As per claims 5, 18, and 27, the combination of Schein and Tomitsuka teaches everything 

as claimed in claims 2, 15, and 24. However, the combination fails to disclose producing a select 

variable and a where variable from a query received from a user. However, this feature was well 

known in the art. 

In a similar field of endeavor, Haddock teaches the process of how an ambiguous query 
is processed and syntactically analyzed to develop a representation of the syntactic structure. 
The system produces a syntactic structure based upon a question/sentence format to represent a 
set of questions, a set of nouns, a set of phrases, and a set of verbs. Additionally, at col. 6, lines 
29-41 Haddock discloses that the system characterizes the query to find values of the variable 
that fulfills the condition or question within the query. In the example provided by Haddock, the 
query produced the syntactic structure (WHICH X s.t. (PAINT *REF(he) X)), and the request of 
the query is to find any values of X that meet the condition of (PAINT *REF(he) X). The 
condition (PAINT REF(he) X), is comprised of a semantic predicate PAINT and two variables, 
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the painter (REF(he)) and the painting (X), which reads on "produces a select variable and a 
where variable from a query received from a user." 

Therefore, it would have been obvious to one of ordinary skill at the time of the 
invention to modify the system of Schein to process the query into a syntactic structure with 
different variables, as taught by Haddock, for the purpose of characterizing the query to find 
values of the variable that fulfills the condition or question within the query. 

As per claims 4, 6, 17, 19, 26, and 28, the combination of Schein and Tomitsuka teaches 
everything as claimed in claims 2, 15, and 24. However, the combination fails to teach the 
implementation of historical information to modify the meaning from the users input query. 
However, this feature was well known in the art. 

At col. 6, lines 48-60, Haddock discloses that in the example query, the meaning of the 
pronoun "he" is ambiguous and in order to resolve the ambiguity for further processing, the 
system uses the history of the dialog of a previous query to determine the reference to the "he", 
in order to form the completed query of (WHICH X s.t. (PAINT DEGAS X)), wherein the value 
of the *REF(he) is obtained from a previous query. 

Therefore, it would have been obvious to one of ordinary skill at the time of the 
invention to modify the system of Schein to implement historical information to modify the 
meaning of the input of the user's input query, as taught by Haddock, for the purpose of 
resolving the ambiguity in the input query. 

As per claim 7, Schein, Tomitsuka and Haddock teach everything as claimed in claim 6. 
However, Schein fails to teach determining whether the query includes both first and second 
type of variable and if so, not using the historical information to modify the user's input query. 
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At col. 6, lines 39-59, Haddock discloses the functionality of the system for determining 
the meaning of an ambiguous query, in which the query representation contains the pronoun 
"he". The query is ambiguous because "it is not yet known who the pronoun "he" refers to 
because that information lies outside the query" (col. 6, lines 45-47). In this instance the system 
uses the history information to determine to whom "he" refers. However, if the utterance 
contains both of the attributes of the utterance, there is no ambiguous query and there is no need 
to use the history vector, as indicated in col. 5, lines 33-42, in which the query provided includes 
the names of the specific painter of whom a user wishes to retrieve information (query 1 and 
query 2), which reads on "determining whether the query includes both first and second type of 
variable and if so, not using the historical information to alter the meaning derived from the 
speech recognizer." 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Schein, to implement determining whether the query includes both a first 
and a second type of variable, for the purpose of reducing unnecessary processing if the meaning 
of the query can be ascertained. 

As per claim 8, Schein, Tomitsuka and Haddock teach everything as claimed in claim 6. 
However, Schein fails to teach determining whether the query includes only one of two variable 
types, and if so, using the historical information to modify the user's input query. 

At col. 6, lines 39-59, Haddock discloses the functionality of the system for determining 
the meaning of an ambiguous query, in which the query representation contains the pronoun 
"he". The query is ambiguous because "it is not yet known who the pronoun "he" refers to 
because that information lies outside the query" (col. 6, lines 45-47). In this instance the system 



Application/Control Number: 09/494,7 1 4 Page 8 

Art Unit: 2654 

uses the history information to determine to whom "he" refers. However, if the utterance 
contains both of the attributes of the utterance, there is no ambiguous query and there is no need 
to use the history vector, as indicated in col. 5, lines 33-42, in which the query provided includes 
the names of the specific painter of whom a user wishes to retrieve information (query 1 and 
query 2). At col. 6, line 13, Haddock specifically states that query 2 is ambiguous because of the 
pronoun "he", and thus the system must resolve the ambiguity of the query via the history 
information. At col. 7, lines 10-35, Haddock refers to the ambiguous fourth query from col. 5, 
lines 42-44, in which "these" is used in the query. The system uses history information to 
determine the reference of the set or subset of paintings "these" actually refers. Haddock's 
determination of needing to use the history dialog to resolve an ambiguous query in one instance 
or not needing to use a history dialog in another instance would suggest and/or motivate one of 
ordinary skill in the art to specifically determine if an utterance includes all necessary variables. 

Additionally, Haddock discloses in order to form the completed query of (WHICH X s.t. 
(PAINT DEGAS X)), the value of the *REF(he) is obtained from a previous query, which reads 
on "merge the variable with the historical information to derive a meaning from the request ." 

Therefore, it would have been obvious to one of ordinary skill at the time of the 
invention to modify the system of Schein to implement determining if an input query includes 
only one of a type of variable, and if so using the history information to form a completed 
query, as taught by Haddock, for the purpose of reducing ambiguity in the query, as suggested 
by Haddock. 
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5. Claims 9-10 are rejected under 35 U.S.C. 103(a) as being unpatentable over Schein in view 
of Tomitsuka as applied to claim 2 above, and further in view of Houser et al (US Patent No. 
5,774,859). 

As per claims 9-10, the combination of Schein and Tomitsuka teaches everything as 
claimed in claims 2. However, the combination does not form time attributes in a request. 
However, this feature was well known. 

In a similar field of endeavor, Houser teaches an information system with a speech 
interface which controls a device such as a television and access to broadcast information. 
Specifically, at col. 30, lines 54-64 and col. 31, lines 39-43, Houser implements processing of 
search requests for television broadcast information based on time ranges ("only within 4 hours" 
or "only after eleven AM"). At col. 30, lines 56-58, Houser teaches that implementation of time 
information commands will limit the search to programming information within an identified 
range. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Schein and implement time command information as taught by Houser, 
for the purpose of limiting the search to programming information within an identified range, 
and therefore decrease system response time and enhance system performance. 

6. Claims 20 and 29 are rejected under 35 U.S.C. 103(a) as being unpatentable over Schein et al. 
in view of Houser (US Patent No. 5,774,859). 
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Regarding claims 20 and 29, Schein discloses everything as claimed in claims 14 and 23. 
However, Schein does not form time attributes in a request. However, this feature was well 
known. 

In a similar field of endeavor, Houser teaches an information system with a speech 
interface which controls a device such as a television and access to broadcast information. 
Specifically, at col. 30, lines 54-64 and col. 31, lines 39-43, Houser implements processing of 
search requests for television broadcast information based on time ranges ("only within 4 hours" 
or "only after eleven AM"). At col. 30, lines 56-58, Houser teaches that implementation of time 
information commands will limit the search to programming information within an identified 
range. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Schein and implement time command information as taught by Houser, 
for the purpose of limiting the search to programming information within an identified range, 
and therefore decrease system response time and enhance system performance. 

7. Claims 1 1 and 21 are rejected under 35 U.S.C. 103(a) as being unpatentable over Schein et al. 
in view of well known prior art. 

As per claims 1 1 and 21, Schein et al. discloses everything as claimed in claims 1 and 
14. Schein et al fail to explicitly teach a system including a processor coupled to the a speaker 
and a microphone, the output of said speaker being subtracted from the output of said 
microphone to reduce interference. However, subtracting undesired signals from a speech signal 
input to a microphone was well known in the art. 
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Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to subtract the output of the speaker from the input of the microphone, as 
was well known in the art, for the purpose of improving the operation of the system by reducing 
interference, and thereby improving the performance and accuracy of the speech recognizer. 

Response to Arguments 
Applicant's arguments with respect to claims 3-11 have been considered but are moot in 
view of the new ground(s) of rejection. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Angela A. Armstrong whose telephone number is 703-308-6258. 
The examiner can normally be reached on Monday-Thursday 7:30-5:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Marsha Banks-Harold can be reached on (703) 305-4379. The fax phone numbers 
for the organization where this application or proceeding is assigned are 703-872-9314 for 
regular communications and 703-872-9314 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-306-0377. 



Angela A. Armstrong 

Examiner 

Art Unit 2654 
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January 25, 2003 



MARSHA D. BANKS-HAROLD 
SUPERVISORY PATENT EXAMINER 
TECHNOLOGY CENTER 2600 



